MULTISTATS NESTED CANALIZING FUNCTIONS 

JOHN O. ADEYEYE ^\ GLAUS KADELKA^**, REINHARD LAUBENBACHER^*, YUAN Ll^'t 

Abstract. The concept of a nested canalizing Boolean function has been studied over the course 
... of the last decade in the context of understanding the regulatory logic of molecular interaction net- 

C^ ' works, such as gene regulatory networks. Such functions appear preferentially in published models 

of such networks. Recently, this concept has been generalized to include multi-state functions, and 
a recursive formula has been derived for their number, as a function of the number of variables. This 
paper carries out a detailed analysis of the class of nested canalizing functions over an arbitrary 
finite field. Furthermore, the paper generalizes the concept further, and derives a closed formula for 
the number of such generalized functions. The paper also derives a closed formula for the number 
of equivalence classes under permutation of variables. This is motivated by the fact that two nested 
^\j . canalizing functions that differ by a permutation of the variables share many important properties 

with each other. The paper contributes to the effort of identifying a class of functions over finite 
fields that are of interest in biology and also have interesting mathematical properties. 



o 

(N 

< 



a 



q 

r-| I 1. Introduction 

Canalizing Boolean functions were introduced by S. Kauffman [B] as appropriate rules in Boolean 

network models of gene regulatory networks. In [5J, a formula for the number of canalizing Boolean 

functions was presented. More recently, a subclass of these functions, so-called nested canalizing 

functions (NCFs) was introduced [7j. The interest in studying these came from dynamic stability 

^' ' properties of networks constructed from such functions. Later, canalizing functions were generalized 

^-v . to any finite set, and a closed formula for the number of such functions was obtained [TU]. A multi- 

t~^ \ state version of nested canalizing functions has been introduced in |131 [T3] , where it was shown that 

cn ■ networks whose dynamics are controlled by multi-state nested canalizing functions have stability 

Tlj" , properties similar to the Boolean case, namely large attractor basins and short limit cycles. An 

^^ \ analysis of published Boolean and multi-state models of molecular regulatory networks revealed that 

the large majority of regulatory rules is canalizing, with most rules being in fact nested canalizing 

[31 El [151 US]- Thus, nested canalizing rules and the properties of networks governed by them are 

important to study because of their relevance in systems biology. Furthermore, they also play a 

^ . role in computational science; it was shown that the class of Boolean NCFs is identical to the class 

^ \ of so-called unate cascade Boolean functions, which has been studied extensively in engineering and 

computer science [1]. This class, in turn, corresponds exactly to the class of Boolean functions with 

corresponding binary decision diagrams of shortest average path length [1]. Thus, a more detailed 

mathematical study of NCFs has applications to problems in engineering and computer science as 

well. For Boolean NCFs, a comprehensive analysis was given in [9j. For multi-state NCFs, based 

on the definition in [14], a similar analysis is described in this paper. We provide a polynomial 

form of NCFs and an explicit formula of the cardinality of the number of such functions for a given 

number of variables. The variables of any NCF are sorted into different layers, according to their 

dominance. Finally, we generalize the concept of NCF and study the number of equivalence classes 

obtained by permuting the variables. The paper is arranged as follows. In Section [21 definitions 
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and notations will be provided, which are then used in Section [3] to prove the main results of the 
paper. Section H] deals with a generalization of the concept of nested canalizing function, and we 
finish with a conclusion in Section [5j 

2. Definitions and Notation 

In this section we review some concepts and definitions from |13t [H] to introduce the computational 
concept of canalization. Let F = Fp be a finite field with p elements, where p is prime. It is well- 
known [12] that a function / : F" — )• F can be expressed as a polynomial, called the algebraic 
normal form (ANF) of /: 

/ \Xi, . . . , Xn) — / ^ (i'k\...kn^\ ' ' ' Xn ; 

0<fcj<p-l, 
1=1, ...,n 

with coefficients afci...A:„ € F. The multivariate degree of the (nonzero) term afcife.-.fcn^i'^^^s'^^ • • • Xn^" 
is defined as ki + k2 + • • • + kn- Like in the one dimensional case, the greatest degree of all the 
terms of / is called its algebraic degree, denoted by deg(/). 

Definition 2.1. A function f{xi,X2,---,Xn) is essential in the variable Xi if there exist r, s € F 
such that 

J \Xij ■ ■ ■ , Xi—i,r, Xj-|_i, . . . , Xn) J^ J \X\, . . . , Xj_i, s, 3^1+1 , • • • , Xfi) . 
as functions. 

Definition 2.2. [TO] Given a, 6 € F and i € {1, . . . , n}, a function f{xi,X2, • • • , Xn) is < i : a : b > 
canalizing if for all Xj ,j^i 

f{xi,. . . ,Xi_i,a,Xi+i,... ,Xn) = b. 

We call Xi the canalizing variable of f. The set S of all a ^¥ such that f is < i : a : b > canalizing 
for some b will be called the canalizing input set with respect to xi, and b will be called the canalized 
output with respect to Xi and a. 

For a function /, we call g a subfunction of f if g was obtained by fixing the values of some variables 
of /. The proof of the following proposition is straightforward. 

Proposition 2.3. // a function /(xi,X2, • • • , x„) is both < ii : ai : bi > and < Z2 : 02 : 62 > 
canalizing, then bi = b2. If Xi is a canalizing variable of f which is still essential in a subfunction 
g, then Xi is also a canalizing variable of g. 

We now assume that F = {0, 1, ... ,p — 1} is ordered, in the natural order 0<l<---<p— 1. A 
proper subset S* of F is called an interval if and only if S = {0, . . . , j} or S'^ = ¥ — S = {0, . . . , j} , 
where < j < p — 1. Hence, a proper subset S is an interval if and only if S'^ is an interval. 

Definition 2.4. [H] Let f be a function in n variables and Si be intervals of¥, i = l,...,n. 
Let a be a permutation of the set {1, 2, . . . , n}. Then f is a nested canalizing function (NCF) in 
the variable order x^-n), . . . , x^/^) with canalizing input sets Si, . . . ,Sn and canalized output values 
bi, . . . ,bn, bn+i with bn 7^ bn+i, if it can be represented in the form 

bi x<^(i) G 5i, 

b2 X<^(i) ^ 5i,X<^(2) G S2, 

h a;<^(i) ^ Si,x^(^2) ^ 'S'2,x^(3) G ^3, 

f{xi,...,Xn) 

"n ''"o-(l) ^ '-'1) • • • ) ^o-(n-l) ^ '-'n-1) ^^^(n) G 0„, 

bn+1 Xfj(^i-^ f: 61, ... , Xfj(^n~l) ^ Sn-l, Xfj(^n) ^ '-'n- 

In short, the function f is said to be nested canalizing if f is nested canalizing in some variable 
order with some canalizing input sets and some canalized output values. 
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Let S = (5i, 5*2, . . . , Sn) and /3 = (61, 62, • • • 1 &n+i) with 6„ / fon+i- We say that / is {cr : S : /?} 
NCF if it is nested canahzing in the variable order Xg-n ) , . . . , x^^ua , with canahzing input sets 
S = {Si, . . . , Sn) and canahzed output values /3 = (61, . . . , bn+i)- 
This definition immediately implies the following result. 

Proposition 2.5. A function / is {u : S : /3} NCF if and only if f is {a : S' : /?'} NCF, where 
E' = {Si,S2,... ,Sn'') and /3' = (61,62,. . . , 6„_2,6n+i,6„). 

Proposition 2.6. Let f{xi, . . . ,Xn) be {a : § : f3} NCF, i.e., f is NCF in the variable or- 
der Xo.(i), . . . , a:o-(n)) ^^^^ canalizing input sets S = {Si, . . . , Sn) and canalized output values /3 = 
(61, . . . ,bn+i). For 1 <k <n-l, fix x^(i) = ai, . . . ,3;^(fc) = Ok, where a, G Si". 

o-(l) cr(fc) 

Then the subfunction f{xi, . . . , ai , . . . , a^ , . . . ,Xn) is {cr* : S* : /3*} NCF on the remaining vari- 
ables, where a* = {a{k -\- 1),... ,cr{n)), §* = {Sk+i, ■ ■ ■ ,Sn), and /3* = (6^+1,. . . ,6„+i). 

Note that all variables appearing in the definition of an NCF must be essential. A constant function 
/ = 6 is however < i : a : b > canalyzing for any i and a. Thus, when a function is said to be 
nested canalizing, we assume that this function is NCF in its essential variables. 

3. Characterization of Nested Canalizing Functions 

In the Boolean case, the extended monomial plays an important role in determining a novel poly- 
nomial form of NCF's [9]. In the multistate case, the product of indicator functions, which was 
used in [14], will take over this role. 



Definition 3.1. Civen a proper subset S of¥, the indicator function (of S") is defined as 

„ , s { Q X e S, 
^^^^) = I 1 X G 5^ 

Lemma 3.2. Let a,b be any nonzero elements of¥, and let S be any interval of¥. The number 
of different functions f = bQs{x) + a, which cannot be written as cQs'{x), where c 7^ and S' is 
an interval of¥, is {p — l)^(p — 2). 

Proof. If a function f{x) = bQs{x) + a can be written as cQs'{x), then 

f = bQs{x) + a=!^l^^ xG5^ ={c lis'" = cQs'{x). 

Since a and c are nonzero, then a + 6 = and, therefore, a = —b must hold for such a function. 
Since F contains p — 1 nonzero numbers, there are p — 1 choices for 6 and p — 2 choices for a to 
obtain / 7^ cQs'{x). Generally, there are 2{p — 1) different intervals S but only half of them lead 
to a different / since every / can be expressed in two different ways: 

bQs{x) + a = 6(1 - Qs4x)) + a= -bQsc{x) + (a + 6). 

Thus, there are {p — l){p — l){p — 2) = {p — l)^{p — 2) different functions / = bQs{x) + a that 
cannot be written as cQs'{x). D 

From the above proof, it is clear that bQs{x) + a = cQs'{x) for some c 7^ and S' if and only if 
a + 6 = 0. 

Lemma 3.3. Given a, 6 7^ and intervals Si, i = 1, . . . ,k with k > 2, then 

(1) /(x) = f{xi, . . . ,Xk) = 6ni=i QSj{xj) + a cannot be written as cf^. ^^ Qs'{xj), where c 7^ 
and all S'j are intervals, j = 1, . . . ,k. 

(2) There are 2 {p — l)'^'+2 different functions of the form 6]^ • -^ Qs {^j) + a. 
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Proof. (1) As in the previous lemma, if a function /(x) = bYl-^Qsj{xj) + a can be written as 
cU''j=iQs'X^j), then 



k 
bWQsjixj) + a 



a 3j : Xj E Sj 

a + b Vi : Xj G S] 



a X G (5i X F^-i) U . . . U (F'^-i x 5^) 

a + 6 xgS'iX...xS'^ 

x G (5[ X F'^-i) U . . . U (F*^-i X S'l^) 
c X G 5;^ X ... X 5^' 

A: 
= cJ|Q5/(Xj). 

i=i 
Since a, ct^O, a + 6 = must hold. Hence, 

S1X---X s^k = is[y- if''"^) u • • • u (f'^-i X 5^). 

This last statement is, however, impossible. Thus, there is no function /(x) = &J| -^^^ Qs (xj) + a 
that can be written as cj| ■ j^ Qs'{xj). 

(2) The nonzero constants a, b can be arbitrarily chosen, with p — 1 choices each. Contrary to the 
previous lemma, each choice of intervals Si, . . . ,Sk leads to a different function because S'J x . . . x 
S^ / {Si X F*'"^) U . . . U (F''"^ X Sk) and because a ^ a + b. For each interval there are 2{p - 1) 
choices, which is why altogether there are {p— l)(p— l)(2(p— 1))'^ = 2^{p — l)'^+2 different functions 
of the form b Y[j=i QSj (xj) + a. D 

The following theorem states the main result of this section. It gives an algebraic characterization 
of nested canalizing functions. 

Theorem 3.1. Given n > 2, the function f{xi, . . . , x„) is nested canalizing if and only if it can be 
uniquely written as 

/(Xi, ...,Xn) = Mi(M2(- • • (Mr-liBr+lMr + Br) + Br-l) ■ ■ ■) + B2) + Bi, (3.1) 

where each Mi is a product of indicator functions of a set of disjoint variables. More precisely, 

Mi = IljLiiQs,^ {xij)),i = l,...,r,ki>l fori = l,...,r,ki-\ h A;^ = n, ^2, . . . , Br+i / 0, -Bi G 

F, {ij\j = 1, . . . ,ki,i = 1, . . . ,r} = {1, . . . ,n}, and, if kr = l,thenBr-\-i + Br j^ 0. 

Proof. First, let 6j = Yl\=i^j- Then it is straightforward to check that any function written as 
in Equation 13.11 is a {a' : S' : /?'} NCF, where a'{xi, . . . ,x„) = (xi-^, . . . ,xi^ , . . . ,Xr^, • • • ,Xr^ ), 
S' = (S'li,... ,5i^^,...,5ri,...,5rfcJ, and /3' = (6i, . . . ,61,62, • • • ,^2, • • • ,br, • • • ,^r-,&r+i)- 

fcl fc2 kr 

Second, suppose / is a {o" : S : /3} NCF, where S = (Si, ^2, . . . , S'n) and /3 = (61, 62, . . . , 6„+i) 
with bn ^ 6„+i. Then there exist ki,i = 1, . . . ,r, ki + ■ ■ ■ + kr = n, ki > 1, such that 61 = 
••• = ^fci =: C'lj^fei+i = ••• = 6fci+fc2 ='■ C'2, • • • ,^fciH — hfcr-i+i = ■ ■ ■ = b„. =: Cr,bn+i =: Cr+i, 
and Cj / Cj+i,j = l,...,r. Let Bi := Ci,B2 := C2 - Ci,...,Br+i = Cr+i - Cr. Then 
Bi G F, ^2, • • • , Br+i G F - {0}. It is straightforward to check that Mi(M2(- • • {Mr^i{Br+iMr + 
Br) + Br-l) • • • ) + ^2) + Bi, with these constants Bi, . . . , Br+i, now equals /, which shows that 
any NCF can be written as in Equation 13.11 

Finally, we need to show that each NCF has a unique polynomial representation, as indicated. 
Without loss of generality, let a be the identity permutation, i.e., let / be nested canalizing in the 
variable order xi, . . . ,x„. Besides, let / be of the form in Equation 13. 1[ Then all the variables 
of Ml, xi, . . . ,Xkj^, are canalizing variables of / with common canalized output Bi. We will now 
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show that xi, . . . ,Xki are all the canalizing variables of / to prove the uniqueness of Mi and Bi. 
If xi G S'f, . . . ,Xfc^ G 5^ , then all the variables of M2, Xjt^+i, . . . ,2:^2, are canalizing variables of 
the subfunction /i = M2(- • • {Mr-i{Br+iMr + Br) + Br-i) • • • ) + (^2 + ^i). Since Bii^ B1 + B2, 
by Proposition 12.31 x^^+i, . . . ^x^,^ are not canalizing variables of /. In the same manner, all the 
variables of M3 are not canalizing variables of /i and thus not canalizing variables of / either, since 
a subfunction of a subfunction is also a subfunction of the original function. Iteratively, we can 
prove that xi, . . . ^xt-^ are the only canalizing variables of /, which makes Mi and Bi unique. In 
the same way, the uniqueness of M2, . . . , M^- and B2, ■ ■ ■ , B^+i can be shown. D 

Because each NCF can be uniquely written in the form of Equation 13.11 the number r is uniquely 
determined by /, and can be used to specify the class of nested canalizing functions. 

Definition 3.4. For an NCF f , written in the form of Equation \3.1\ let the number r he called its 
layer number. Essential variables of Mi are called most dominant variables (canalizing variables), 
and are part of the first layer of f . Essential variables of M2 are called second most dominant 
variables, and are part of the second layer. Iteratively, essential variables of M^ are called k most 
dominant variables, and are part of the fc*^ layer. 

Remark 3.5. In the Boolean case (p = 2), each Mi in Theorem \3.1\ is an extended monomial, 
and, since B^+i + -Br = 1 + 1 = 0, k^ is greater than 1. Thus, Theorem \3.1\ reduces to its Boolean 
version, already stated as Theorem J^.2 in [9J. On the other hand, if Br+i + B^ would be zero, then 
kr = 1 is impossible since the function could be uniquely written in r — 1 layers by the comments of 
Lemma\3.S\ 



A function can be nested canalizing in different variable orders but only all variables in the same 
layer can be reordered. More precisely, we have the following result. 

Corollary 3.6. Let a and r] be two permutations of {!,... ,n}, and let f be both {a : S : /?} NCF 

and {r] : §' : P'} NCF, then 

(1) {Xa{l),--- ,Xa(ki)} = {Xri(l)i--- >2;^(fci)} 

{^a{ki + ---+kr-i + l)i ■ ■ ■ ?Xa{n)} = {^ri{ki+-+kr-i+l)7 ■ ■ ■ )^r?(n.)}- 

(2) /3 = /?' = {bi,...,bn,bn+i) and bi = ■ ■ ■ = bk^, . . . ,bk^+...+kr-i+i = ■■■ = K 

(3) 61 / 6fci+i, bk.,+1 7^ bkx+k2+i-, ■ ■ ■ &fci+-+fcr+i+i 7^ K+i- 

Proof. By Theorem 13. 11 / can be written as a unique polynomial of the form of Equation l3.lt and 
all equalities follow from this representation. D 

This corollary allows to determine the layer number of any NCF by only looking at its canalizing 
output values. For example, if p = 3 and if / is nested canalizing with canalized output values 
p = (1, 1, 1,0, 0, 0, 2, 0, 0, 2, 2, 1) (n = 11), then the layer number of / is 5. 
Let NCF(n) denote the set of all nested canalizing functions in n variables. 

Corollary 3.7. For n >2, the number of nested canalizing functions is given by 

n I 

|NCF(n)| = 2--Mp - 2) ^(^ " ^r^'"' E k^m"^'. ■ k^.^l 

r=2 fciH \'kr-i=n—l 



ki>l,i=l,...,r-l 
n-1 



+2>5^(p-ir+'^ J2 



n 



ki\k2l---kr\ 

r=J. feiH \-kr=n 

ki>l,i=l,...,r-l,kr>2 
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Proof. If r = 1, then / = B2M1 + Bi. Similar to Lemma I3.3| the number of such functions is 

(2(p — l))"(p — l)p = 2"(p — 1)"+^^, since i?i G F can be arbitrarily chosen, and ki = n. 

For r > 1, Equation 13.11 yields that for each choice of /ci, . . . , A:,., ki > 1, i = 1, . . . , r, there are 

{2{p — 1)) J ("^ ^^k'~ ^"^) ^^ys to form Mj, j = 1, . . . , r. For those NCF's with kr = 1, by Lemma 

13.21 there are {p — l)^(p — 2) different functions of the form Br+iMr + Br with Br 7^ 0. For the 

remaining NCF's, i.e. those with kr > 1, Lemma [3.31 yields that there are {p — l)^(2(p — l))'^'' ways 

to form Br+iMr + -B^, with Br 7^ 0. 

Note that there are p — 1 choices for each Bi, 2 < r < Br-i, p choices for Bi, and 2(p — 1) choices 

for each canalizing input interval. Hence, the total number of NCF's with r > 1,^^ = 1, can be 

given by 



r=2 feiH |-fer-l=n-l 

fei>l,j=l,...,r-l 



{n-ki)\ (n - fci - • • ■ - fer_2)! 



h,^ ^, - 1 (fci)!(n-fci)!(fc2)!(n-fci-fc2)!fc.-i!(n-fci fc,_i)! 

' — ^ K\ -\~ ■ ■ ■ ~p Al 7^ — ]^ — 71 — J. 

fei>l,i=l,...,r-l 
n I 

r=2 feiH hfer~l=ii— 1 

fei>l,i=l,...,r-l 

Similarly, the total number of NCF's with r > \,kr > 1 \s 

"" = £' E «" - '»*■■* ■^'' (::) (" I'') -t"' ".: ■ ^ "-) <- - ')'<" - ^r^ 

r=2 ki + ---+K=n \ i-/ \ z / \ r / 

ki>l,i=l,...,r-l,kr.>2 



^2" V V ( lyt+r- "' ("~fci)! (n-fci fc^_i)! 

^^ .^^,- [k^)\{n-k^)\{k2)\{n-ki-k2)\"' kr\{n-k^ fc,)! 

ki>l,i=l,....x-l,kr>2 

n— 1 , 



2>^(p-ir+'- ^ 



kl\k2\---kr\ 

r—2 fciH \-krr—n 

ki>l,i=l,...,r-l,kr>2 

By combining all three groups of NCF's, one gets that the total number of NCF's in n variables is 
given by 

|NCF(n)| = 2"(p - l)"+ip + N1 + N2 

n I 

= 2-v(j-2)E(f-ir'-' E ,.„,,., ,, 

r=2 feiH Ykr~\=n—\ 

fe,>l,i=l,...,r-l (3.2) 

n— 1 , 

n! 



+2>5^(p-ir+'^ ^ 



kilk2l---kr 

r=l fciH hA;,.=n 

fci>l,j=l,...,r-l,fc,,>2 



D 



Note that for p = 2 we get the same formula as in [9]. However, we are now also able to compute the 
number of multistate NCF's. For example, when p = 3 and n = 2, 3, 4, we get 192, 5568, 219468, 
respectively; when p = 5 and n = 2, 3, 4, we get 5120, 547840, 78561280, respectively. These results 
are consistent with those in [14]. 
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It has been shown in [14j that the number of multistate nested canahzing functions can be calculated 
recursively. Thus, by equating 13.21 to the recursive relation, we have 



n-l / X 

4(p - l)^ a„ = Y,[ ^ J '^'"Hp - ^Y^n-r+i + 2^~\p - l)"+i(2 + n{p - 2)), n > 3 



Corollary 3.8. For the nonlinear recursive sequence 

n-l 
r=2 

it holds that 

|NCF(n)| =pa„ 

and the explicit solution for an is given by 



2"-i(p-2)^(p-ir+'^-i Y^ 



n\ 



r=2 fciH \-kr-i=n—l 

fc,>l,i=l,...,r-l 



ki\k2l ■ ■ ■ kr-ll 



n-l 



+2"^(p-ir+'^ ^ 



n 



kilk2l---kr\ 

r=l fciH \-kr=n 

ki>l,i=l,...,r-l,kr>2 

4. Generalization and Permutation Equivalence of NCF's 

In this section, we generalize the concept of nested canalizing functions to any finite field Fg, where 
q is a power of a prime. Besides, the canalizing sets are no longer restricted to intervals containing 
exactly one endpoint but can be any proper subset of Fg. Within this setting, similar results as in 
the previous section are obtained. Since the proofs are basically the same as in Section O we just 
list the main results and omit the proof. 

Definition 4.1. Let f be a function in n variables over ¥q, and let Si be proper subsets of¥q, 
i = 1, . . . ,n. Let a be a permutation of the set {1,2, . . . ,n}. Then the function f is a nested 
canalizing function in the variable order Xo-(i), . . . , ^^-(n) with canalizing input sets Si, . . . ,Sn and 
canalized output values 6i, . . . ,6„;^n+ij with bn 7^ bn+i, if it can be represented in the form 



f{xi,...,Xn) 



bi x^(i) G ^i, 

62 a;<^{i) ^ 5'i,x^(2) G ^2, 

^3 a;<^(i) ^ 5'i,x<^(2) ^ 5'2,a;^(3) e ^3, 



On Xa{l) ^ '-'1) • • • 1 X(T{n—l) ? '-'n-l) X^(^n) ^ '-'n; 

On+1 ^^^(l) ^ Di, . . . , Xo-(„„i) ^ '-'n-l) Xcr{n) ^ '-'n- 

The function f is called nested canalizing if f is nested canalizing in some variable order with some 
canalizing input sets and some canalized output values. 

This definition generalizes the concept of nested canalizing functions as defined in |13j. However, 
NCF's defined in this way can still be uniquely represented as a polynomial as discussed above. 
The following theorem is a generalized version of Theorem 13.11 with the same arguments used to 
prove it. 

Theorem 4.1. Given n > 2, the function / : F" ^ Fg is nested canalizing if and only if it can be 
uniquely written as 

/(xi, . . . ,X„) = Mi(M2(- • • (Mr-liBr+lMr + B,.) + S.-l) • • • ) + ^2) + ^1, (4.1) 

where each Mi is a product of indicator functions of a set of disjoint variables. More precisely, 
we have that Mi = Wjl^AQ s^ .{xi,)) ,i = 1, . . . ,r, ki > 1 for i = 1, . . . ,r,ki + . . . + kr = n. 
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B2, . . . , Br+i 7^ 0, Bi £ F, {ij\j = 1, . . . , A:j,i = 1, . . . ,r} = {1, . . . ,n}, each Si, i = 1, . . . ,n is any 
proper subset of Fg, and, if kr = 1, then Br+i + Bj- ^ 0. 

As in the previous section, we can count the number of NCF's and get 

Corollary 4.2. For n > 2, the number of NCF's over Fg, where NCF's are defined as in Definition 
\4-l\ is given by 



2"-ig(g-2)(2^-i-ir^(g-iri Yl 



n\ 



r=2 feiH \-kr—i=n—l 

ki>l,i=l,...,r-l 

ra— 1 I 

n! 



+ 2^(2^-1 -l)"^(g- If Y. 



ki\k2\---kr\ 

r=l fciH \-kr=n 

k^>l,i=l,...,r-l,kr>2 

Proof. The proof equals the one of Corollary 13.71 We just replace the number of elements p in the 
finite field by q , the number of nonzero elements, p — 1 hy q — 1, and the number of intervals, 
2p — 2, by the number of proper subsets 2'^ — 2, respectively. D 

Definition 4.3. Given two functions f{xi, . . . ,Xn) and g{xi, . . . ,x„) over Fg. We call f and g 
permutation equivalent if there exists a permutation a such that f{x\, . . . ,x„) = ^(^^(i), . . . ,x„(n\). 

It is well-known that equivalent functions share many properties. For example, two equivalent 
Boolean nested canalizing functions have the same sensitivity and the same average sensitivity 
|lHl9]. Having an equivalence relation on the set of all NCF's, the number of different equivalence 
classes of NCF's is of interest. However, we first need the following combinatorial result. 

Lemma 4.4. ^(Page 70) Given n, r and Si, i = 1, . . . ,r and s = si -\- ■ ■ ■ + Sr < n. Then the 
number of integer solution of the equation ki + ■ ■ ■ + k^ = n, where ki > Si, is 

E_ /r + n- s - V 
~ \ r-l 

fciH Vkr=n 

ki'>Si,s=si-\ hs,.<ra 

Theorem 4.2. The number of different equivalence classes of NCF's, defined as in Definition \4-l\ 
is 

iV = 2'"-^(g-l)g"(2'?-i-l)". 

Proof. By only considering the number of different NCF's with a fixed canalizing variable order a 
in Equation 14. H we get exactly the number of different equivalent classes. Thus, we can follow the 
same enumerative schedule as we did in the proof of Corollary 14.21 The only difference is that we 
do not consider the permutation of the variables now. Hence, we get 



N = 2^-\{q - 2)(2'?-i - 1)" Y{q - If-^ Yl ^ 



r=2 


kl + --- + kr-l=n~l 

k^>l,i=l,...,r-l 


n-1 

>>-ir 


y, 1 

feiH \-kr=n 

k,>l,i=l,...,r-l,kr>2 



2^-~\{q - 2)(2'?-i - 1)" ^(<7 - ly-^ ( [! _ 2 + 2>(2^-i - 1)" ^(g - 1) 

r=2 ^^ ^ r=\ 

2'^-^q{q - 2)(2'?-i - l)"(g - l)g"-2 + 2"g(2«-i - l)"(g - l)^"-^ 
2"-i(g-l)g"(2«-i-l)", 



r — 1 
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where we used Lemma 14.41 to eradicate the sums in the second equaUty. D 



5. Discussion 

In this paper, we generahzed the concept of nested canalization to finite fields without any restriction 
on the canahzing input sets. By using the product of indicator functions, a generalization of 
extended monomials, we successfully generalized the characterization of Boolean NCF's |9] to the 
multistate case. Besides, we discussed the permutational equivalence of NCF's, and a number 
of different equivalence classes was obtained. The main contributions of the paper are threefold. 
Firstly, we have established a closed form formula for the number of multistage nested canalizing 
functions as defined in [TH], improving on the recursive formula given there. Secondly, we have 
established a very general definition of multistate nested canalizing function for which several 
analytical results still hold true. And here as well, we establish a closed form formula for the 
number of such functions. And, thirdly, we have characterized and calculated the number of 
equivalence classes of NCFs under permutation equivalence. 
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